.1 



(19) 



J 



(12) 



(43) Date of publication: 

29.04.1998 Bulletin 1998/18 



EuropSisches Patentamt 
European Patent Office 
Off toe europeen des brevets (11) EP 0 838 942 A2 

EUROPEAN PATENT APPLICATION 

(51) Int. CI. 6 : H04N 1/407 



(21) Application number: 97203231.2 

(22) Date of filing: 16.10.1997 



CM 
< 
CM 

o> 

CO 
CO 
CO 

o 

GL 
LU 



(84) Designated Contracting States: 


• Gallagher, Andrew 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


Rochester, New York 14650-2201 (US) 


NL PT SE 






(74) Representative: 


(30) Priority: 28.10.1996 US 736840 


Nunney, Ronald Frederick Adolphe 




Kodak Limited, 


(71) Applicant: EASTMAN KODAK COMPANY 


Patent Departement (W92)-3A, 


Rochester, New York 14650 (US) 


Headstone Drive 


(72) Inventors: 


Harrow, Middlesex HA1 4TY (GB) 


• Goodwin, Robert M. 




Rochester, New York 14650-2201 (US) 





(54) Method and apparatus for area selective exposure adjustment 



(57) A digital image having a dynamic range repre- 
senting a brightness in an original scene greater than 
the dynamic range of an output medium, is processed to 
fit the dynamic range of the output medium by dividing 
the image into first and second portions, the first portion 
of the image representing a brightness range extending 
from a minimum brightness up to a distance equal to the 
dynamic range of the output medium, the second por- 
tion of the image representing a brightness range 
extending from a maximum brightness down to a dis- 
tance equal to the dynamic range of the output medium. 
First and second transformations are determined for the 
first and second portions of the image respectively that 
map the first and second portions onto the dynamic 
range of the output medium using a exposure determi- 
nation algorithm of the type used in photographic print- 
ers. The digital image is then thresholded at a 
brightness level that divides the image into a first region 
having the lowest levels of brightness and a second 
region having the highest levels of brightness. Finally, 
the first transformation is applied to the first region of the 
image and the second transformation is applied to the 
second region of the image to produce a digital image 
having a dynamic range that matches the dynamic 
range of the output medium while maintaining natural 
contrast within objects in the image. 
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Description 

FIELD OF THE INVENTION 

The invention relates generally to the field of digital image processing, and in particular to area selective exposure 
adjustment, a technique related to dodging and burning in conventional photographic printing. 

BACKGR OUND OF THF INVENTION 

The dynamic range of images captured on one medium (such as negative film) may exceed the dynamic range of 
the medium that the image is rendered on (such as photographic paper). This results in a loss of image detail in the 
rendered image. The detail may be lost in the highlight portion of the image (such as when a backlit image is printed 
hght enough to properly render the shadow detail, but rendered too light to show the highlight detail such as the clouds 
m the sky). Or the detail may be lost in the shadow portion of the image (such as when a "flash-in-the-face" imaqe is 
rendered properly for the subject of the picture, but the background is rendered too dark to show the detail in the back- 
ground). In conventional photographic printing techniques, these problems are addressed by the process of "dodginq" 

0r ,'^ , u 9 "L, , e . SUbtraC ^ 9 eXP ° SUre ,rom selected S" 3 *™ a^as of the image (dodging), or adding exposure to 
selected highlight areas of the image (burning). ^ 

With the advent of digital image processing, it was possible to easily rescale the any image data so that it fits and 
fills the dynamic range of the oulput medium, such as a photographic print. However this type of image data modifica- 
tion often produces undesirable alterations in the visual contrast within objects reproduced by the output medium This 
is especially true when the dynamic range of the image on the capture medium exceeds the dynamic range of the out- 
put medium when the captured image is reproduced at a natural or preferred contrast, and the rescaling operation then 
reduces the contrast within the reproduced objects by an undesirable amount. In such a case, capability for selectively 
controlling exposure in certain areas of the image, similar to the burning and dodging capability in conventional photo- 
graphic pr.nt.ng. is desirable. For example, U.S. patent No. 5.218.350 to Bollman discloses a digital image processing 
method for dodging defined areas of an image using a soft edged mask for the areas to be dodged. The areas to be 
dodged are defined either manually or by edge finding software or other selection techniques and are encoded as a bit 
map control plane. The edges of the bit map control plane are blurred which produces unallowed intermediate control 
„ tween zero and one - A Quantization function is applied to the intermediate control values to restore them to 

allowed bit map values. The blurred bit map is then used to control the appearance characteristics of the final image 

One problem with this approach is that the known methods of defining the areas to be processed are very labor 
intensive, requiring excessive operator interaction with the image processing apparatus. Another shortcoming is that 
the process of applymg the quantization function to the intermediate control values results in a loss of spatial resolution 
in the bit map control plane thereby performing exposure adjustments in unintended areas. 

There is a need therefor for an improved method of digital image processing for performing Area Selective Expo- 
sure Adjustment (ASEA). 

SUMMARY OF THE INVENTION 

The present invention is directed to overcoming one or more of the problems set forth above. Briefly summarized 
according to one aspect of the present invention, a digital image having a dynamic range representing a brightness in 
an original scene greater than the dynamic range of an output medium, is processed to fit the dynamic range of the out- 
put medium by dividing the image into first and second portions, the first portion of the image representing a brightness 
range extending from a minimum brightness up to a distance equal to the dynamic range of the oulput medium the sec- 
ond portion of the image representing a brightness range extending from a maximum brightness down to a distance 
equal to the dynamic range of the output medium. 

First and second transformations are determined for the first and second portions of the image respectively that 
map the first and second portions onto the dynamic range of the output medium using a exposure determination algo- 
rithm of the type used in photographic printers. The digital image is then thresholded at a brightness level that divides 
the .mage into a f .rst region having the lowest levels of brightness and a second region having the highest levels of 
br.gMness. Finally, the first transformation is applied to the first region of the image and the second transformation is 
applied to the second region of the image to produce a processed digital image. 

These and other aspects, objects, features and advantages of the present invention will be more clearly understood 
and appreciated from a review of the following detailed description of the preferred embodiments and appended claims 
and by reference to the accompanying drawings. ' 
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ADVANTAGEOUS EFFECT OF THE INVENTION 

The present invention is advantageous in that it produces a processed digital image that has a dynamic range that 
matches the dynamic range of the output medium while maintaining natural contrast within objects in the image. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram of the essential components of an image processing system used to apply the method of Area 
Selective Exposure Adjustment according to the present invention; 

10 

FIG. 2 is a flow chart showing the essential steps of the method of Area Selective Exposure Adjustment according 
to the present invention; 

FIG. 3 is a histogram of an image requiring processing according to the present invention; 

15 

FIG. 4 is a histogram of an image showing how it is divided into two ranges each of which will fit on the dynamic 
range of the output medium; 

FIG. 5 is a flow chart showing one method of using an exposure determination algorithm to determine the balance 
20 transform for each range of image data according to the present invention; 

FIG. 6 is a flow chart showing a second method of using an exposure determination algorithm to determine the bal- 
ance transform for each range of image data according to the present invention; 

25 FIG. 7 is a diagram of the essential components of a computer terminal and GUI interface useful for practicing the 
present invention; 

FIG. 8 is a diagram showing the method of correcting a brightness range mask using an operator defined rectan- 
gular area; 

30 

FIG. 9 is a table showing the FIR filter kernel values useful in the blurring step of the present invention; 

FIG. 10 is a set of tables showing a portion of the brightness range mask at various stages of modification accord- 
ing to the present invention; 

35 

FIG. 1 1 is a table showing the filter kernel values useful for finding edges required for the mask modification proc- 
ess according to the present invention; 

FIGs. 12-18 are diagrams useful in describing the steps of one method of the mask modification process according 
40 to the present invention; 

FIGs 19-24 are diagrams useful in describing the steps of a second method of the mask modification process 
according to the present invention; 

45 FIG. 25 is a histogram of an image after it has been modified by the method of Area Selective Exposure Adjustment 

according to the present invention; 

DETAILED DESCRIPTION OF THE INVENTION 

so The invention may be practiced using the digital image processing apparatus illustrated in FIG. 1 . The digital image 
processing apparatus includes a digital image source 2 which may be a digital camera or a photographic image scan- 
ner, such as a Photo CD scanner, a computer 4 running image processing software controlled by an operator using a 
graphical user interface (GUI), a computer terminal with a monitor and keyboard 6 , and mouse or other control device 
8 , and an image output device 10 such as a video display or hardcopy printer such as a laser printer or a thermal 

55 printer. 

FIG. 2 is a flow chart showing the essential steps of the method of the invention. As image data 18 is accessed, the 
first step is to form a cumulative histogram from the data 20. The histogram is used to determine the image data's effec- 
tive range, and that range is compared to the dynamic range of the output medium 22. For instance, photographic paper 
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used in the negativeypositive system will render the reflectances of most naturally occurring objects with a pleasing or 
natural contrast if they all received above the same level of illumination at the time they were photographed This implies 
L'Tro! °* de " atte i whicn wi " render P'oPe"* thus any negative containing a larger range of densities is a candidate 
fm a'^L XP ° SUre Ad,ustment < ASEA > Howe ver. « image data fits on the dynamic range of the output 
medium then ASEA is not required, and the processing method awaits the next image 24. 

-,7 3 If r l teS 3 histo9ram 01 ima9e data that is a candidate for ASEA. It shows a histogram of input image data 

26 Sh^T^h •!^ Qe 1 th !. OU,PUt m6dium 38 FIG 4 shows how ,he ima9e data ^ di^ded into two ranges in step 
26 each of which will fit on the dynamic range of the oulput medium. The first range of image data 39 extends from a 
tow percentage point (such as the 1% point) on the cumulative histogram, up to a value which defines a range that will 

L°^^r^r 9e ° f , the ^ m6diUm - The SeCOnd range 40 extends from a hi 9h Percentage poirrt (such as 
h! Tl^l m CUm " la i ve h'stogram down to a value which defines a range that will fit on the dynamic range of 
the output med.um. Normally these two ranges will overlap to some extent. However, if the range of the image data were 
so large that rt exceeded the dynamic range of the output medium by more than a factor of two. then it would be divided 
into three or more ranges. However, the explanation will continue assuming that two ranges are sufficient 
i- ^Tr" 9 ^ FIG 2 : the ba ' anCe fof the firSt ra " 9e of ima9e data presenting Primarily the shadow or lower light 
LThLhif?^ h 6 TJ". ,' n !? ^ thS 6313,106 for S6COnd ra " 9e 01 ima9e data representing primarily the highlight 
or higher hght level detail ,s determined in 30 by a set of similar operations. As used herein, the term "balance" refers 
to me lightness and color of the output image. Conventionally, the exposure determination algorithms in photographic 
So 9 P™^ have been referred to as color and density balance algorithms. The present invention employslcon- 
t^^ in L^!? 5 ^ ^!^ nC6 a| 9 ori thms for performing steps 28 and 30. For a further explanation of steps 26 
through 30 in FIG 2 refer to FIG. 5. Two copies of the original image data 41 are used. In step 42 the pixels in the first 
t ho fil are ^?t I'** r3n9e 3re m unc han9ed while the pixels in those portions of the image which are outside of 
the frst range, NOT R1 in step 42. are replaced (pixel by pixel) with the average of the image data in the first range This 
amended image data 44 is then sent to an automatic exposure determination algorithm 46 (such as are used in high 
speed optical printers or in a Photo CD scanner, see for example U.S. patent No. 4.945,406) to calculate the proper bal- 
a nH 6 ^ an 2T 48 ^ th ! f r t ran ° e ima9edata Symmetrically in step 52 the pixels in those portions ofthe sec- 
ond copy of the image which are outside of the second range. NOT R2 in 52. are replaced (pixel by pixel) by the average 

«™ f. ,m T 3 c a .' n f SeCOnd r3n9e - ThiS ^nded image data 54 is also sent to the automatic exposure determina- 
tion agonthm 46 to calculate the proper balance transform 56 for the second range of the image date 

ima „L h ? "L^ tr3t6S 3 1, altemative method to accomplish steps 26 through 30 in FIG. 2. Again two copies of the original 

infhnS £225 62 th t P L Xe,S in ,hS ^ whiCh are in ,irst ran9e are 'e« unchanged while the 

=hh 1 J ^ ^ ° me im39e Wh,Ch 3re ° utside 01 the ,irs t range, NOT R1 in 62. are replaced (pixel by pixel) by 
S£2 r r erenC ^? 6 ^, een the 3Ver39e Va,ue of the pixels in the ,j rst range and the average value of the pixels out- 
s.de the first range (IN - OUT, to the pixels outside the first range 64. This amended image data 66 is then sent to an 
automatic exposure determination algorithm 68 (such as are used in high speed optical printers or in a Photo CD scan- 
ner, see for example U.S. patent No. 4.945.406) to calculate the proper balance transform 70 for the first range of the 

«nn Tot^o Y Jo 72 ^ ^ ^ of second «W of the image which are outside of the 

second range. NOT R2 in 72. are replaced (pixel by pixel) by adding the difference between the average value of the 
pixels ,n the second range and the average value of the pixels outside the second range (IN - OUT) to the pixels outside 

T e T°^ T 96 ? *. 3mended im39e d3ta 76 iS a,S ° Senl to * e aromatic exposure determination algorithm 68 
to calculate the proper balance transform 78 for the second range of the image data. 

H-J^f*."? 1 t0 RG 2 ' ,° nCe Pr ° per balanCe transforms are determined in 28 and 30, the original image data is 
divided ,nto two non-overlapping regions which correlate with thedifferent brightness levels in the original scene These 
non-overlapping regions are spatial regions in the image, in distinction to the ranges of brightness in the image histo- 

S^fhJT 6 USS ^ ab ° W * THe im39e iS divid6d int ° the *"° re9ions in ste P 3 2 ^ generating a mask which 
t ™,ilo^T n K A " ernat ' Ve,y ' if tnere is a 9radient of brightness levels, then the mask may be generated so that 
rt correlates wrth the brightness gradient. This may be done using one or more of the techniques described below in 
which the mask generation step is guided by an operator who in the preferred embodiment is working at a computer 
25f?T ^' SUChas * ose manufactured and sold by SUN Microcomputer Systems, illustrated in FIG. 7. The work- 

S fSSSL'SS- 88 «• a mouse or o*ier control device 84.andavideo monitor 86 displaying both the image 

88 and the location of the currently defined mask 90 as well as a GUI 92 having sliders for adjusting common mode (N) 
red (R), green (G). and blue (B) threshold values which define the location of the mask 90 

Initially the mask 90 is defined by the threshold values for the image data. These thresholds are adjusted by the 

t?™« U f n9 i GU ' 92 *° d6fine 106 re9i0n ° f the ima9e ^responds to the brigrrtest region in 

S^ J V he J ,,9h ' 9ht mask >- ^ thresholds may be adjusted for all three colors simultaneously or for £t one 
color at a bme. In the preferred embodiment, visual feedback is provided to the operator by showing the highlight region 
boundary 90 defcned by the current RGB threshokfs on a vfcfeo display 86. The high.ight mask is encoded by aTovertey 
image defined by the region of the image which lies inside boundary 90 and which in the preferred embodiment has a 
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value 1 in this highlight region. By definition, those elements not in the highlight mask are in the other "shadow" mask 
91 whose location outside the boundary 90 is encoded by O's in the overlay image. 

This encoding is illustrated in FIG. 8 for another example. The shadow region 94 is encoded by O's while the high- 
light region 96 is encoded by Vs However, because some of the low reflectance objects in the high illumination region 

5 may have the same image values as high reflectance objects in the low illumination region ("confounding" reflectances), 
it may not be possible to make a perfect selection of the highlight region using thresholds alone, as illustrated by region 
100 in FIG. 8. In this case, additional operations are necessary to define the highlight region. 

One additional operation is to use a standard GUI interface (click-pull-click) to define one or more rectangular "over- 
ride" mask regions which are to be either in the highlight mask or in the shadow mask irrespective of the threshold being 

10 used. This is illustrated in FIG. 8 by the dashed line defining area 98 in the highlight mask 96 in which the O's are to be 
forced to be Vs. This can be very effective for relatively large areas with confounding reflectances contained entirely 
within an area of the image which was exposed with a single (or restricted range) of illumination. 

Another additional operation is to blur the mask 96 with a symmetric finite impulse response (FIR) filter (i.e. blur the 
overlay image). FIG. 9 shows an array 101 of numbers which are the kernel values for a preferred 5x5 blurring filter 

75 which has a bandpass of about one quarter the sampling frequency. The mask 96 (see FIG. 8) may be blurred by larger 
amounts by repeatedly subsampling it by a factor of two and filtering again using the filter array 101. When a satisfac- 
tory level of blur is reached, as determined by the operator, the mask 96 is resampled back up to its original size using 
linear interpolation. Those skilled in digital filtering will recognize that FIR filters of other sizes and designs may be used 
equally well to accomplish this blur, subsample, blur, and resample operation. This process generates an overlay image 

20 with values intermediate between 0 and 1 . These intermediate values may be used as weights to define the relative 
weights of the first and second balance transforms, 34 in FIG. 2. Again in the preferred embodiment, the degree of blur 
may be selected by an operator using a GUI similar to that shown in FIG. 7 except the threshold slider 92 is replaced 
by a degree of blur slider, and the effect of the blur on the mask is displayed on a video display 86. This is very effective 
in filtering out small areas of confounding reflectances within an area of the image which was exposed with a single (or 

25 restricted range) of illumination. It may also be effective in defining a gradient for the balance transform in images which 
exhibit a brightness gradient. It has been found that the greater the difference between the levels of illumination in the 
different areas in the image, the less the mask needs to be blurred. 

Yet another additional operation is to use a look-up table (LUT) to modify the values in the mask. FIG. 10 illustrates 
this LUT operation. Array 102 shows a section of one row of pixels in the mask at a boundary between the highlight 

30 region (coded as Vs) and the shadow region (coded as O's) before blurring. Array 104 shows the effect of blurring on 
the mask values. Because the preferred filter is symmetric, the gradient in the filtered mask is symmetric with respect 
to the location of the original boundary. The particular gradient shown is for illustration purposes only. Array 106 illus- 
trates the effect of putting the mask image through a LUT which was designed to increase the gradient for any mask 
values near to but below 0.50. The particular increase shown is for illustration purposes only. It is obvious to any one 

35 skilled in the use of LUTs that the gradient for any range of mask values could be modified to increase or decrease the 
local gradient for that range of mask values. The example shown in 106 would produce a more abrupt transition from 
the shadow region balance transform to the highlight region balance transform in the shadow region only. As illustrated 
in array 108 a LUT may also be used to shift the location of any value in the range of the mask. It shows that the mask 
values illustrated in array 104 have been moved to the right one pixel location with corresponding changes in the gradi- 

40 ents involved. The use of a LUT to modify the mask permits the mask gradient within a brightness range to be adjusted 
to accommodate a more natural looking transition at its boundary, and it allows small adjustments of the location of the 
boundary between the two brightness ranges. 

A preferred equation for generating the mask shaping LUT is given by: 



45 



mvout = 0, in the range 0 <= mvin < 0.005; 



mvout = mvoff + (mvoff - 0.002) *tanh[ssf*(mvin - 0.5)]/0. 75991, in the range 0.005 <= mvin < 0.5; 



mvout = mvoff + (0.998 - mvoff) *tanh[hsf*(mvin - 0.5)]/0. 75991, in the range 0.5 <= mvin < 0.995; and 



50 



mvout = 1, in the range 0.995 <= mvin < 1.0. 



Where 



55 mvin 



is the mask value to be input to the LUT; 
is the mask value output by the LUT; 

is the mask value to be output by the LUT when the input value is 0.5; 
is the shadow scale factor which shapes the shadow portion of the mask; 



mvout 
mvoff 
ssf 
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hsf is the highlight scale factor which shapes the highlight portion of the mask; 
and 

tanh is the hyperbolic tangent function. 

Since in some scenes certain areas require a blurred mask (generally areas of low edge activity) while other areas 
require a relatively sharp mask (generally areas of higher edge activity). A morphological filtering operation is illustrated 
in FIGs. 11-18, where one line of the image is shown for illustrative purposes, the horizontal axes representing the hor- 
izontal location in the line of an image, and the vertical axes representing the image or mask amplitudes. The morpho- 
logical filtering operation may be used to combine masks with different degrees of blurring. The morphological filter 
operation is selected by the operator using a GUI on the computer 80. First, an edge finding filter, 130 in FIG. 1 1 , is 
applied to the original scene, with the result illustrated for one line 131 of the image in FIG. 12. The sharp and blurred 
masks over the same region are illustrated by 132 and 133 in FIGs. 13 and 14. respectively. In FIG. 15, line 134, the 
edge image 131 is clipped by applying a threshold T1. The clipped image 134 is then blurred and thresholded again at 
a threshold T2 as illustrated in FIG. 1 6 by line 1 35. The clipped and blurred image is then normalized back to 1 , resulting 
in the mask illustrated by line 136 in FIG. 17. To obtain the final image-wise mask, mask 136 is multiplied by imagewise 
mask 133 and the product is added to imagewise mask which is the result of imagewise mask 132 multiplied by (1 - the 
mask in 136). This produces a imagewise mask 137 shown in FIG. 18 with a sharp edge 138 in one location and a 
blurred edge 140 in another location. This operation has proven to be useful in processing backlit scenes with natural 
subjects, such as trees and bushes, silhouetted against the sky. 

A final step which may be performed in step 32 of FIG. 2 is a second morphological filtering operation which is use- 
ful for removing small isolated regions in the mask caused by confounding reflectances. This final step will be described 
with reference to FIGs. 19-24, where one line of the image is shown for illustrative purposes, the horizontal axes repre- 
senting the horizontal location in the line of an image, and the vertical axes representing the mask amplitudes. A mask 
120 is shown in FIG. 19 with an unwanted area 142 in the highlight region due to confounding reflectances. This mask 
120 is saved, as the corrected mask will later be made directly from it. In order to remove the unwanted portion of the 
mask, the following procedure is used. As illustrated in FIG. 20, the mask 120 is blurred with a symmetric FIR filter, 
resulting in blurred mask 121, until the region of confounding reflectance has dropped below the upper limit indicated 
by a threshold T3. The threshold T3 is set to clip off the confounding reflectance. The result of clipping at the threshold 
is shown as mask 122 in FIG. 21. Next, this mask 122 is blurred resulting in blurred mask 123 in FIG. 22. The blurred 
mask is thresholded again (T4 in FIG. 22), which results in mask 124 shown in FIG. 23. Threshold T4 is set low enough 
so that the high (logic 1) portion of mask 124 in FIG 23 is extended beyond the edge of that portion of the original mask 
120 in FIG 19 that is to be retained. The corrected mask 125 in FIG. 24 is obtained by multiplying (logic AND) mask 124 
in FIG. 23 with the original mask 120 in FIG. 19. The final mask 125 in FIG. 24 compared to the original mask 120 in 
FIG. 19 is unchanged except for the isolated small highlight region, unwanted area 142, which has been removed. The 
amount of blurring and the placement of the thresholds, T3 and T4, determine the size of the isolated area, 142, that 
will be removed. A symmetrical operation may be performed to remove isolated shadow regions. 

Returning to FIG. 2, after the mask is generated in step 32, the first and second balance transforms are applied to 
the first and second regions respectively in 34. This can result in the final image 36 processed by Area Selective Expo- 
sure Adjustment. However, a final optional operation 35 which an operator may apply is often advantageous. This oper- 
ation increases the difference between the balance of the two regions. This may be done by moving the balance of the 
less important region of the image further away from the balance of the more important region, or the balance transform 
of both regions 1 and 2 may be slightly compromised to eliminate any remaining unacceptable artifacts in the image. 
Often this results in a more natural looking image anyway, since the observer of the print does remember a certain 
degree of difference in the illumination in the original scene even though they can't remember exactly how great the dif- 
ference was. The operator may make these final adjustments to the balance transform using GUI similar to the one 
shown in FIG. 5 except that the threshold adjustment is replaced by individual image balance adjustments for the sep- 
arate portions of the image defined by the mask, as well as an adjustment to the balance transform of the entire image. 
This operation is advantageous because exposure determination algorithms do not always produce the optimum bal- 
ance for a given image or portion thereof. Furthermore, the final mask may change the perceived balance of the princi- 
pal subject necessitating a slight balance readjustment. 

FIG. 25 shows how the portions of the histogram 37 of FIG. 4 of the original image are redistributed as a result of 
the application of Area Selective Exposure Adjustment according to the present invention to the image data. It shows 
that both the highlight region 150 of the image and the shadow region 152 of the image are reproduced with their natural 
or intended contrast and yet they also both fall within the dynamic range 154 of the output medium. 

As with any imaging system, the processed image, 36 in FIG. 2, must he rendered by an output device as shown 
in 10 of FIG. 1. It is rendered to the output medium in the same manner as an image which was unaffected by ASEA 
would be. For instance in rendering a print from a scanned negative, after the original scanned image is balanced, it is 
put through a series of color correction matrices and LUTs which define the color gamut and tone scale of the rendered 
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image. Finally it is adjusted by a hardware calibration matrix and/or LUT and the resulting image file is sent to the printer 
hardware for printing. It is also conventional to utilize 3D LUT's in place of the series of matrices and LUTs for this ren- 
dering and calibration operation. Any conventional technique known to those skilled in the art may be used to render 
and produce output images from image data corrected by ASEA according to the present invention. 
5 The invention has been described with reference to a preferred embodiment. However, it will be appreciated that 

variations and modifications can be effected by a person of ordinary skill in the art without departing from the scope of 





the invention. 
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Claims 

1. A method for processing a digital image having a dynamic range representing a brightness in an original scene 
greater than the dynamic range of an output medium, comprising the steps of: 

a) dividing the image into first and second portions, the first portion of the image representing a brightness 
range extending from a minimum brightness up to a distance equal to the dynamic range of the output medium, 
the second portion of the image representing a brightness range extending from a maximum brightness down 
to a distance equal to the dynamic range of the output medium; 

b) determining first and second transformations for the first and second portions of the image respectively that 
map the first and second portions onto the dynamic range of the output medium using an exposure determina- 
tion algorithm; 

c) thresholding the digital image at a brightness level that divides the image into a first region having the lowest 
levels of brightness and a second region having the highest levels of brightness; and 

d) applying the first transformation to the first region of the image and the second transformation to the second 
region of the image. 

2. The method claimed in claim 1 , wherein the determining step comprises the steps of: 

a) computing the average of the image values in the first portion of the image, 

b) substituting that average value computed in step a) for each image value in the portion of the image outside 
of the first portion of the image, before using the exposure determination algorithm to compute the first trans- 
form; 

c) computing the average of the image values in the second portion of the image; 

d) substituting that average value computed in step c) for each image value in the portion of the image outside 
of the second portion of the image, before using the exposure determination algorithm to compute the second 
transform. 

3. The method claimed in claim 1 , wherein the determining step comprises the steps of: 
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a) computing a first average of the image values in the first portion of the image and a second average of the 
image values in the portion of the image not in the first portion; 

b) computing the difference between the first and second averages; 

c) before using the exposure determination algorithm to compute the first transform, subtracting the absolute 
5 value of the difference computed in step b) from the image values in the portion of the image not in the first 

portion; 

d) computing a third average of the image values in the second portion of the image and a fourth average of 
the image values in the portion of the image not in the second portion; 

e) computing the difference between the third and fourth averages; 

10 f) before using the exposure determination algorithm to compute the second transform, adding the absolute 

value of the difference computed in step e) to the image values in the portion of the image not in the second 
portion; 

4. The method claimed in claim 1 , wherein the thresholding step comprises the steps of: 

75 

a) defining rectangular areas in the image which are forced to be in the first region irrespective of the threshold 
for the brightness value being used; 

b) defining rectangular areas in the image which are forced to be in the second region irrespective of the 
threshold for the brightness value being used. 

20 

5. The method claimed in claim 4, wherein the location of the rectangular regions are selected by an operator using 
a computer monitor to view the location of the region in the image and using a computer graphical user interface 
(GUI) to place the rectangle in the image (click - pull to opposite corner - click). 

25 6. The method claimed in claim 1 , wherein the step of thresholding the image at a brightness level is performed by an 
operator. 

7. The method claimed in claim 6, wherein the operator adjusts the brightness threshold value using a computer 
graphical user interface (GUI) such as a slider bar while viewing the location in the image of the brightness thresh- 
so old value by means of a computer monitor. 

8. The method claimed in claim 1 , wherein the first and second brightness regions are defined by an imagewise mask 
with values 0 in the first region and 1 in the second region. 

35 9. The method claimed in claim 8, further comprising the step of blurring the image wise mask with a symmetric finite 
impulse response filter (FIR). 

10. The method claimed in claim 9, further comprising the step of changing the gradient of the blurred region of the 
imagewise mask using a look-up table (LUT). 

40 

11. The method claimed in claim 10, wherein an operator adjusts the degree of blur and gradient adjustment using a 
computer graphical user interface (GUI) such as a slider bar while viewing the effect of the blur and gradient adjust- 
ment on the image wise mask by means of a computer monitor. 

45 12. The method claimed in claim 8, further comprising the steps of: 

a) f iltering the image with an edge finding filter to form an edge image; 

b) blurring and thresholding the edge image to define regions of high and low edge activity; and 

c) using these regions of edge activity to define areas for different levels of blurring of the image wise mask. 

50 

1 3. The method claimed in claim 12, wherein an operator adjusts the different levels of blurring of the image wise mask 
using a computer graphical user interface (GUI) such as a slider bar while viewing the effect of the blur on the mask 
by means of a computer monitor. 

55 14. The method claimed in claim 8, further comprising the steps of: blurring, thresholding, and reblurring the image 
wise mask to create a second spatial mask, and multiplying the image wise mask by the second spatial mask to 
eliminate small isolated regions in the image wise mask which have the opposite value from the mask value in the 
regions surrounding them. 
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15. The method claimed in claim 14, wherein an operator adjusts the different levels of blurring, thresholding, and reb- 
lurring of the image wise mask using a computer graphical user interface (GUI) such as a slider bar while viewing 
the effect of the blurring and thresholding on the mask by means of a computer monitor. 

16. The method claimed in claim 1 , further comprising the step of adjusting the first and second transforms to produce 
an output image which looks more like an output image resulting from a single transform of the digital image having 
a dynamic range representing a brightness in the original scene greater than the dynamic range of the output 
medium. 

17. The method claimed in claim 16, including the step of adjusting the first and second transforms using a computer 
graphical user interface (GUI) such as a slider bar while viewing the transformed image by means of a computer 
monitor. 
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(57) A digital image having a dynamic range repre- 
senting a brightness in an original scene greater than 
the dynamic range of an output medium, is processed to 
fit the dynamic range of the output medium by dividing 
the image into first and second portions, the first portion 
of the image representing a brightness range extending 
from a minimum brightness up to a distance equal to the 
dynamic range of the output medium, the second por- 
tion of the image representing a brightness range 
extending from a maximum brightness down to a dis- 
tance equal to the dynamic range of the output medium. 
First and second transformations are determined for the 
first and second portions of the image respectively that 
map the first and second portions onto the dynamic 
range of the output medium using a exposure determi- 
nation algorithm of the type used in photographic print- 
ers. The digital image is then thresholded at a 
brightness level that divides the image into a first region 
having the lowest levels of brightness and a second 
region having the highest levels of brightness. Finally, 
the first transformation is applied to the first region of the 
image and the second transformation is applied to the 
second region of the image to produce a digital image 
having a dynamic range that matches the dynamic 
range of the output medium while maintaining natural 
contrast within objects in the image. 
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